206 PART 5 Looking for Relationships with Correlation and Regression

4.

Calculate the test statistic:

0 269 0 131

2 05

.

.

.

/

5.

Look up 2.05 in a normal distribution table or web page such as https://

statpages.info/pdfs.html (or edit and run the R code provided earlier

in “Testing whether r is statistically significantly different from zero”),

and observe that the p value is 0.039 for a two-sided test.

A two-sided test is used when you’re interested in knowing whether either r is

larger than the other. The p value of 0.039 is less than 0.05, meaning that the

two correlation coefficients are statistically significantly different from each

other at α = 0.05.

Determining the required sample

size for a correlation test

If you are planning to conduct a study where the outcome is a correlation between

two variables designated X and Y, you need to be sure to enroll a large enough

sample so that if the correlation is indeed statistically significant, you have enough

sample for r to show it. As described in Chapter 11 with the t test and the ANOVA,

the sample size can be estimated through one big equation, where you plug the

estimated effect size along with the α and power you select into an equation, and

calculate the sample size (see Chapter 3 for the scoop on effect size and selecting

α and power).

For a sample-size calculation for a correlation coefficient, you need to plug in the

following design parameters of the study into the equation:»

» The desired α level of the test: The p value that’s considered significant

when you’re testing the correlation coefficient (usually 0.05).»

» The desired power of the test: The probability of rejecting the null hypoth-

esis if the alternative hypothesis is true (usually set to 0.8 or 80 percent).»

» The effect size of importance: The smallest r value that is considered

practically important, or clinically significant. If the true r is less than this value,

then you don’t care whether the test comes out significant, but if r is greater

than this value, you want to get a significant result.

It may be challenging to select an effect size, and context matters. One approach

would be to start by referring to Figure 15-1 to select a potential effect size, then

do a sample-size calculation and see the result. If the result requires more sam-

ples than you could ever enroll, then try making the effect size a little larger and

redoing the calculation until you get a more reasonable answer.